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ONTENTS SERVER, CONTENTS RECEIVING APPARATUS, NETWOR 
SYSTEM AND METHOD FOR ADDING INFORMATION TO DIGITAL 

CONTENTS 



FIELD OF THE INVENTION 



The present invention relates to a method for distributing the digital contents, and more 
particularly to a method for adding predetermined information to the digital contents along wrth 
the distribution of the digital contents. 



BACKGROUND 



I„ distributing the video ot sound as digital data (digital contents), it is common ptacnceto 
embed the electronic watennark infonnation (digital watetmatk) in the digital contents tn otde, 
to designate a source of the digital contents ot enhance the secunty. 

Nowadays, various kinds of digital contents arc distributed on-line via a netwotk such as the 
mtetnet, in which mere is a demand fot an application for adding the informatton 0*^°" 
infonnation) diffetent fot each distribution destination ot uset it, disputing the dtgtial 
contents, as prevention means fot preventing illegal use of the dismbuted dtgttal contimti, mi 
25 means fot designating a secondary distribution destination (tins application . hercmafte 
tefetred to as a fingerprint). To implement mis fingerprint, the additional mfonnatton may be 
described in a format header of the digital contents. However, considering that the dtsmbuted 
digital contents are possibly subjected to various edits including compresston DA/AD 
conversion, and format conversion, it is effective to embed the additional mfotmatton to the 
30 digital contents themselves, employing a digital watennark technique. 

As above described, one pntblem is mat in the fingerprint, it is rcqutied to change tite 
information added to tite digital contents for each user to access or each dtstnbution destination 
35 However, a pmcess of embedding the digital watermark to the digital contents compnses 
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calculating an operation amount in a range without influence on the quality of digital contents 
themselves (without deterioration in the visual or aural elements), whereby the processing 
calculation cost is generally very high. Therefore, if a different digital watermark is embedded 
for each access to the digital contents, a server providing the digital contents (hereinafter 
5 referred to as a contents server) has a very high load. 

In a digital contents distributing system practically on-line, it is required for a plurality of users 
to gain access simultaneously and acquire desired digital contents. However, in the above 
system where the contents server has high load, the number of users capable of gaining access 
10 simultaneously can not be increased to lack the practicality of the system. 

In the case where the digital contents are distributed in the recent network system, the digital 
contents of distribution object are usually non-reversibly compressed due to a limited 
bandwidth in the network environment. Therefore, it is required to perform a process of 
15 unpacking and recompressing the digital contents to embed a digital watermark, so that the 
contents server has more load. 

Particularly, in a streaming distribution in which the contents distribution in real time needs to 
be guaranteed for each user, it is a significant problem that the contents server has an increased 
20 load. 

SUMMARY OF THE INVENTION 

Thus, it is an object of the present invention to embed a different digital watermark in the 
25 digital contents for each access without increasing load at the contents server to the utmost. 

Also, it is another object of the invention to implement a digital contents distribution system 
practically on line, employing such a digital watermark-embedding technique. 

30 In order to accomplish the above object, the present invention is implemented as a network 
system configured in the following way. This network system comprises a contents server 
distributing digital contents via a network, and a client terminal receiving the distributed digital 
contents. And this client terminal transmits an acquisition request for desired digital contents to 
the contents server, and the contents server switches and synthesizes the plurality of digital 

35 contents where a different digital watermark is embedded for each specific part to generate the 
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15 



digital contents with predetermined information embedded in response to this acquisition 
request and transmits the generated digital contents to the client terminal. 

Preferably, this contents server comprises a contents storage part for storing a plurality of digital 
contents where a different digital watermark is embedded, and an information addmg part for 
by reading out a plurality of the digital contents from the contents ^^ "T^l 
synthesizing the digita. contorts for each specific part, addiog to the dtgrtd 1 confcntt 
information specified by a digital watermark being embedded for each part of the digital 



contents. 



Also, another network system of the invention comprises a server distnbutmg digital content, 
and a client terminal receiving the distributed digital contents. This server distributes a plurahty 
of digital contents wherein a different digital watermark is embedded at the same tutu. On the 
other hand, this client terminal switches and synthesizes the plurality of received digital 
contents for each specific part to add predetermined information to the digital contents. 

This network system is implemented as a broadcasting network such as television broadcasting, 
to this case, the server is a broadcasting station and the client terminal is a receiving apparatus 

. . • 



such as a television receiver. 



Preferably, this client terminal comprises a receiving means for receiving a plurality of dtgttri 
contents wherein a different digital watermark is embedded, and an information addmg means 
for, by switching and synthesizing the plurality of digital contents received by ft. recemng 
means for each specific part, adding to the digital contents informal speetfied by a dtgttal 
25 watermark being embedded for each part of the digital contents. 

Moreover, the invention is implemented as a computer configured in the following way. That 
is, this computer comprises a selector for inputting a plurality of digital contents where,,, a 
different digital watermark is embedded, and for outputting while swtemng ^ selecttve ly the 
30 plurality of digital contents for each specific part, and a control part for controlling the se.ecte 
Led on a predetermined embedment information, the computer generattng by a control at the 
control part, digital contents wherein me embedment information is described wtth a btt mw 
being formed by the digital watemark-embedded in for each of the part of the dtgttal contents. 

35 Another invention to accomplish the above object is implemented as a method for adding 
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information to digital contents by using a computer. That is, this information adding method 
comprises a first step of generating a plurality of digital watermark-embedded contents by 
embedding a different digital watermark in predetermined digital contents, and a second step of, 
by switching and synthesizing the plurality of digital contents where a different digital 
5 watermark is embedded for each specific part, adding to the digital contents information 
specified by a digital watermark being embedded for each part of the digital contents. 

In this method for adding information to digital contents, the first step comprises compressing 
the generated digital contents, and creating the pointer information pointing to a delimiter 
10 position in the part of the compressed digital contents, and the second step comprises 
synthesizing the digital contents based on the pointer information, and adding the information 
to the digital contents without unpacking the digital contents. 

Further, the invention is implemented as a program for performing the data processing by 
1 5 controlling a computer. This program comprises a first process for reading out predetermined 
embedment information from a predetermined storage device, and a second process for 
acquiring a plurality of digital contents where a different digital watermark is embedded, 
selectively switching the plurality of digital contents for a specific part, based on the 
embedment information, and generating the digital contents describing the embedment 
20 information, using a bit sequence formed with a digital watermark-embedded in each specific 
part of the digital contents. Such program is provided in a magnetic disk, an optical disk, a 
semiconductor memory, or other recording medium, or distributed via a network. 

THE FIGURES 

25 

Various aspects of the invention are illustrated in the Figures appended hereto. 

Figure 1 is a diagram schematically showing the overall configuration of a digital contents 
distributing system according to a first embodiment of the present invention; 

30 

Figure 2 is a block diagram typically showing a hardware configuration of a computer suitable 
for implementing a contents server according to the first embodiment of the invention; 

Figure 3 is a diagram showing the functional configuration of the contents server according to 
35 the first embodiment of the invention; 
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Figure 4 is a diagram for explaining a method for generating the fingerprint information in a 
fingerprint performing part according to the first embodiment of the invention; 

5 Figure 5 is a diagram for explaining another method for generating the fingerprint information 
in the fingerprint performing part; 

Figure 6 is a diagram for explaining a further method for generating the fingerprint information 
in the fingerprint performing part; 

10 

Figure 7 is a flowchart for explaining a process for generating the digital watermark-embedded 
contents in a digital watermark-embedding part according to the first embodiment of the 
invention; 

1 5 Figure 8 is a flowchart for explaining a process for generating the fingerprint information in a 
fingerprint performing part according to the first embodiment of the invention; 

Figure 9 is a block diagram showing a process for making fingerprint with digital watermark in 
the compressed contents according to the first embodiment of the invention, as compared with 
20 the conventional process; 

Figure 10 is diagram showing how to generate the fingerprint information by switching a 
plurality of contents compressed and with digital watermark-embedded for each raw data block; 
and 

25 

Figure 11 is a diagram schematically showing the overall configuration of a system for 
distributing the digital contents according to a second embodiment of the invention. 

As shown in the Figures, element 10 is the Contents server, element 11 is the Original contents 
30 storage part, element 12 is the digital watermark-embedding part, element 13 is the Digital 
watermark-embedded contents storage part, element 14 is the Fingerprint performing part, 
element 20 is the Client terminal, element 30 is the Network, element 40 is the Broadcast 
station, element 50 is the Receiving apparatus, element 51 is the Receiving component, 
element 52 is the Contents using part, element 101 is the CPU, element 102 is the M/B chip 
35 set, element 103 is the Main memory, element 105 is the Hard disk, element 106 is the 
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Network interface, element 141 is the Contents selector, and 142 is the Pseudo random 
number generator. 

5 

DETAILED DESCRIPTION 

The first and second embodiments of the present invention will be described below in detail 
with reference to the accompanying drawings. 

10 

[First embodiment] 

Figure 1 is a diagram schematically showing the overall configuration of a digital contents 
distributing system according to a first embodiment of the present invention. 

15 

As shown in Figure 1, the system of this embodiment comprises a contents server 10 that 
possesses and distributes the digital contents (hereinafter simply referred to as contents) such as 
video or sound via a network 30 and a client terminal 20 that receives the contents distributed 
from the contents server 10. 

20 

In this embodiment, the contents server 10 makes a fingerprint with digital watermark in the 
contents in distributing the contents. That is, the contents server adds the information different 
for each distribution destination or user (identification information) to the contents, using the 
digital watermark. 

25 

The client terminal 20 receives the contents distributed from the contents server 1 0. The user at 
the client terminal 20 operates the client terminal 20 to employ (reproduce or peruse) the 
acquired contents. The fingerprint made in the contents has no influence (deterioration of 
image quality or sound) on the use of the contents, because the information is added using a 
30 digital watermark technique. 

The network 30 is any one of the networks usable for distributing the contents, such as 
information communication networks such as the Internet and various kinds of WAN (Wide 
Area Network) or LAN (Local Area Network), and the broadcasting networks such as for 
35 television broadcasting. The network line may be wire or wireless. 
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10 



Figure 2 is a bloek diagram typically showing a hardware configuration of a computer suitable 
for implementing the contents server 10 in this embodiment of the inventron. 

TOe computer in Figure 2 comprises a CPU (Central Processing Unit) that ^ ^ 
means a main memory 103 connected to the CPU 101 viaanM/B (mother board) chrp set 102 
Ta CPU bus, a Z card .04 connected to me CPU 10, via me MS 1 chip set 102 and an 
AGP (Accelerated Graphics Port), a hard disk 105, a network interface 106 and a USB port 107 
connected to the M/B chip set 1 02 via a PCI (Peripheral Component Interconnect) bus, and 
Lpy disk drive 109 and a keyboard/mouse 1 10 connected viathe PCI bus, a bndge errcm, 108 
2 * tow speed bus such as an ISA (Industry Standam Arehitecture) bus to the M/B chrp set 



102. 



Figure 2 only exemplifies the hardware configuration of the computer that rmplements tins 
,5 irdimet bu, vlus outer configurations may be taken as far as mis —00, - 
TZble For example, a video memory may be only mounted, instead of provrdrng me v,deo 
2 04 to process L image data in Ore CPU .01. A CD-ROM (Compact Drsc Read Only 
MeXi or DVD-ROM (Digital Versatile Disc Read Only Memory) drive may be provrded va 
an interface such as ATA (AT Attachment). 

20 The client terminal 20 may be configured by me computer as shown to Figure 2 Uketire 
contents server 10. A.SO, it may be realized by a PDA (Persona. Drgrtal Assrstant), a portable 
telephone, or other information terminal units having the network functron. 

25 Figure 3 is a diagram showing the functional configuration of the contents server 1 0. 

As shown in Figure 3, the contents server .0 comprises an original contents stomge part Ufa 
storing the original contents, a digital watermark-embedding part 12 for embeddrng a drgrtal 
wlLrk in I original contents, a digital watermark-embedded contents stomge part .3 for 
30 Iring me contents with the digital watermark-embedded, and a fing«pnn. perfonmng part 14 
ZZL a fingerprin, (adding fingenrrin, information) employing me — wrm me 
digital watermark-embedded. 

to the configuration as showrt in Figure 3, the digita. watenuark-eml^ng part 12and the 
35 fingerprint performing part 14 are virtual software blocks mat are unplememed by the CPU 
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under program control. Also, the original contents storage part 11 and the digital 
watermark-embedded contents storage part 1 3 are implemented by a storage device such as the 
main memory 103 or the hard disk 105. 

5 In Figure 3, the characteristic configuration in this embodiment is only shown. In practice, the 
contents server has the general server functions such as accepting an access request from the 
client terminal 20. 

The original contents storage part 1 1 stores the original data of the contents distributed from the 
10 contents server 10, and the digital watermark-embedding part 12 reads out predetermined 
contents from the original contents storage part 1 1 , embeds a digital watermark in the contents, 
and stores the contents in the digital watermark-embedded contents storage part 13. 

The digital watermark-embedding part 1 2 embeds plural kinds of digital watermark in one kind 
15 of contents to generate a plurality of digital watermark-embedded contents. The plurality of 
generated digital watermark-embedded contents represent the bit information 0 for one part and 
the bit information 1 for the other part. 

Also, an operation of embedding digital watermark in the contents is performed beforehand, 
20 irrespective of the process for distributing the contents. 

The fingerprint performing part 14 reads out the digital watermark-embedded contents meaning 
the bit information 0 and the digital watermark-embedded contents meaning the bit information 
1 from the digital watermark-embedded contents storage part 13, and switches and synthesizes 
25 these two kinds of contents for each specific part (partial set). Thereby, a bit row is formed by 
the digital watermark-embedded in the contents and the information in the fingerprint 
(fingerprint information) is described by this bit row. 

This embodiment deals with a digital watermark-embedment detecting method based on a 
30 frequency diffusion technique typically employed as the digital watermark technique. With this 
method, a signal sequence b(n) representing the bit information is modulated by a pseudo 
random number sequence p(n), and convoluted with a partial set C(n) of a contents original 
signal (original contents) C to embed any bit information. The partial set C(n) of the contents 
original signal C is a data set of contents divided in accordance with an appropriate rule. Each 
35 data is a part of original contents, and the whole of the original contents is constituted by an 
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entire set. 



Cc(n) ~ C(n) I a><[2b(n) - l]*p(n) 

where b(n)-[0,l] 

5 C(n)iC, C(i)UCG)-f(i'j) 

Ce(n> = CrnHaxr2b(nVllx P (n) 
where bfaWO. 11 
C(n)eC. C(DAC(n=f (i'n 

10 

Herein, Ce(n) is a partial set of the contents Ce with the fingerprint made (i.e., for distribution), 
a is a parameter representing the intensity of digital watermark, and n is an index representing a 
part of the contents necessary to embed the 1 bit information. 

15 In detecting the digital watermark-embedded by this method, the following calculation is 
performed 

ft(n) 

= Cc(n)xp(n) 

20 ~ C(n)xp(n) I a><[2b(n)-l]*p(n)* £ a*[2b(n) l]«(n)* 



EM 

= Ce(n)xp(n) 

25 = C(n)xp(nHaxr2b(nVnxp( n y - axr2b(nM1x(nV 



Thereby, the embedded bit information b(n) is detected by comparing an obtained value with a 
30 certain threshold. 

Also, in making the fingerprint in the contents with this method, 2b(n)-l takes the values of ±1, 
because the signal sequence b(n) is the bit information. Accordingly, the digital 
watermark-embedding part 12 generates the contents CeO and Cel where digital watermark is 
3 5 embedded in both cases of b(n)=0 and b(n)= 1 . 
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CcO(n) - e(n)-ap(n)(ecO(n)ICcO) 
Cc 1 (n) = C(n) I ap(n) (Cc 1 (n)iCc 1 ) 

5 CeO(n) =* CfnVap(n) (CeOfnteCeO) 

Cel(nl = C(nHap(a> (CeUnteCel) 

That is, the contents CeO(n) means the bit information 0, and the contents Cel(n) means the bit 
1 0 information 1 . 

When the fingerprint is made on a contents original signal C, employing the contents CeO and 
Cel with digital watermark-embedded, the fingerprint performing part 14 switches the contents 
CeO(n) and Cel(n) in accordance with the information m(n) to be embedded as the fingerprint 

15 information (hereinafter referred to as embedment information m(n)) for each partial set C(n). 
Thereby, the contents Cf where embedment information m(n) described using the bit 
information as the fingerprint information is embedded is generated. The embedment 
information m(n) may be arbitrarily set up, depending on the distribution destination or time of 
the contents, and stored in a predetermined storage device (main memory 1 03 in the computer 

20 as shown in Figure 2). 

Cf(n) - (m(n)— 0)? Cc0(n):Ccl(n) (Cf(n)ICf) 
Cf(n) = (m(n>=K»? CeOfnVCelfn) (Cf(n)eCf) 

25 

Where Cf(n) is a partial set of Cf 

Figure 4 is a diagram for explaining a method for generating the fingerprint information in the 
fingerprint performing part 14. 

30 

As shown in Figure 4, the fingerprint performing part 14 comprises a contents selector 141 for 
inputting the digital watermark-embedded contents CeO and Cel, and selectively switches and 
outputs the digital contents, and a pseudo random number generator 142 as control means of the 
contents selector 141. 

35 
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The contents selector 141 inputs the digital watermark-embedded contents CeO meaning the bit 
information 0 and the digital watermark-embedded contents Cel meaning the bit information 1. 
And it selectively switches and outputs a partial set CeO(n) of the contents CeO and a partial set 
Cel(n) of the contents Cel in accordance with a pseudo random number sequence generated by 
5 the pseudo random number generator 142 to generate the contents Cf with fingerprint made. 

The pseudo random number generator 142 calculates a seed of pseudo random number on the 
basis of the access information including the terminal information (terminal ID) of the client 
terminal 20 having issued an acquisition request for the contents and the information regarding 
10 the user of the client terminal 20 (user ID), calculates a pseudo random number function 
employing the obtained seed, and generates a pseudo random number sequence for controlling 
the contents selector 141. 

In this manner, the contents selector 141 is controlled employing the pseudo random number 
15 sequence generated by the pseudo random number generator 142, so that the bit information is 
formed with digital watermark-embedded for each partial set Cf(n) of the contents Cf with 
fingerprint. Employing this bit information, the fingerprint information corresponding to the 
embedment information m(n) is described in the contents Cf. 

20 Figure 5 is a diagram for explaining another method for generating the fingerprint information 
in the fingerprint performing part 14. 

In this example, the contents where a digital watermark corresponding to the bit information 0 
is embedded and the contents where a digital watermark corresponding to the bit information 1 
25 is embedded are prepared each in plural number. A pseudo random number sequence p(n) for 
describing the bit information is generated employing the predetermined access information and 
a certain key. Also, the generated pseudo random number sequence p(n) is changed by 
changing the value of this key in accordance with a certain rule. 

30 That is, the digital watermark-embedding part 12 generates the digital watermark-embedded 
contents CeOk and the digital watermark-embedded contents Celk in plural number at least 
corresponding to the variable kinds of pseudo random number sequence p(n), which are 
employed to describe the fingerprint information. 

35 Cc0k(n)-C(n)-ap(n,k)-(Cc0k(n)iCc0k) 
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Cclk(n) - C(n) I ap(n,k) (Cclk(n)iCclk) 

CeOkfn) = CfnVafn.k) (CeOkfnteeOk) 
Celk(n) = C(nHafn^ (Celk(n)eelk) 

5 

where k is an index of the key (i.e., seed of pseudo random number). Assuming that the total 
number of k is K, the digital watermark-embedded contents CeOk and the digital 
watermark-embedded contents Celk are generated each at least in K ways. 

10 

Referring to Figure 5, the contents selector 141 inputs the digital watermark-embedded contents 
CeOk and the digital watermark-embedded contents Celk each in K ways, and selectively 
switches and outputs a partial set CeOk(n) of the contents CeOk and a partial set Celk(n) of the 
contents Celk in accordance with a pseudo random number sequence generated by the pseudo 
15 random number generator 142 to generate the contents Cf with fingerprint. 

Cf(n) ~ (m(n)— 0)? CcOk(n):Cclk(n) (Cf(n)fCf) 

Cf(n) = (m(n)=0)? CeOkfn^Celkfn) (CfTnteCf) 

20 

where A=X?Y:Z is a description method in the programming language such as C language, 
meaning that A= Y if X is true, or A=Z if not. 

25 

The pseudo random number generator 142 calculates the seed of pseudo random number in a 
maximum of K ways, based on the access information and the key, and calculates a pseudo 
random number function employing the obtained seed to generate a pseudo random number 
sequence for controlling the contents selector 141 . 

30 

That is, in this example, though the digital watermark-embedded contents CeOk representing the 
bit information 0 and the digital watermark-embedded contents Celk representing the bit 
information 1 are generated each in plural number, the contents where a digital watermark 
corresponding to the bit information (i.e., 0 or 1) suitable for describing the embedment 
35 information m(n) is embedded is selected, whereby the desired embedment information m(n) is 
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Accordingly it is possible to enhance the security against the attacks nom ine 
same. Accordingly, n P finaerprint information by changing p(n) 

5 distribution destination standing in to decode the nngerpnm 

employing the key for each access. 

Figure 6 is a diagram for explaining a fnr«her mefitod for generating the fingerprint information 
in the fingerprint performing part 14. 
10 in this example the fingerprint information is generated, employing the original contents C in 

ongmal contend C. For exanpte, ^ a ^ ^ ^ ^ 

« -"— - > — is 

20 by x. 

TT* bit infotmation is interpreted by discarding s smaller detected values from the detected 
«M dieted iron, J the partial sets Cff.0) to C«N-1) (thereby removmg the partial sets 

—ion (pans described as x in the above example)), and employmg 

25 N-s detected values. 

in Fime 6 the contents selector 141 inpnts the digital watermark-embedded contents CeO tite 
^iT^rmLlembedded cements Cel and ihe original — C, and selectively swtiches 
td"^ se, CeOCn) of fire — CeO, a partia, set Ce 1( n) of *e contents «- 
m a rmZ set C(n) of the contents C in accordance with a pseudo random number sequence 
gently me pseudo random number generator .42 ,o generate fire contents Cf wtth 

fingerprint. 

Cf(n) = (x(n)=l)? C(n):(m(n)=0)? CeO(n):Cel(n) 
35 (Cf(n)ICf) 
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(CffnteCfl 

Where x(n) is a function of returning 1 in n if the original contents are used, or 0 if not. 

5 

The pseudo random number generator 142 calculates the seed of pseudo random number, based 
on the access information, and calculates a pseudo random number function employing the 
obtained seed to generate a pseudo random number sequence for controlling the contents 
selector 141 in the same manner as in Figure 4. 

10 

In this manner, it is possible to enhance the security against the attacks from the contents 
distribution destination standing in to decode the fingerprint information by adequately 
providing a part without containing bit information in the contents, and changing the position of 
the part without containing bit information. As a method for embedding the bit information, the 
1 5 fingerprint information may be generated employing a plurality of digital watermark-embedded 
contents CeOk and Celk prepared and the original contents C, as shown in Figure 5. 

Referring to the flowcharts of Figures 7 and 8, a processing flow of the contents server 1 0 in 
this embodiment will be described below. 

20 

Figure 7 is a flowchart for explaining a process for generating the digital watermark-embedded 
contents in the digital watermark-embedding part 12, and Figure 8 is a flowchart for explaining 
a process for generating the fingerprint information in the fingerprint performing part 14. Since 
the method for generating the fingerprint information as shown in Figure 4 is considered a 
25 special case (k=l) of the method as shown in Figure 5, a process for generating the digital 
watermark-embedded contents CeOk and Celk in K ways (total number of k) will be described. 

As shown in Figure 7, the digital watermark-embedding part 12 reads out the original contents 
C to embed a digital watermark from the original contents storage part 1 1 . Then, it is checked 
30 whether or not the original contents C are compressed, and if compressed, the original contents 
are unpacked (steps 701, 702). 

Then, the digital watermark is embedded in the original contents C to generate the 2K digital 
watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] (step 703). 

35 
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Lastly, the digital watermark-embedding part 12 stores the generated digital 
watermark-embedded contents Ce0[l], Ce0[2],.., CeO[K], Cel[l], Cel [2],.., Cel[K] in the 
digital watermark-embedded contents storage part 13 (steps 704, 706). When the digital 
watermark-embedded contents Ce0[l], Ce0[2],.., CeO[K], Cel[l], Cel[2],.., Cel[K] are 
5 compressed and stored, each contents are compressed, and the pointer information pointing to a 
delimiter position of a partial set for each compressed contents is generated (steps 704, 705), 
and then is stored together with the compressed contents in the digital watermark-embedded 
contents storage part 13 (step 706). The details of the pointer information will be described 
later. 

10 

The fingerprint performing part 14 makes a fingerprint on the contents involving an acquisition 
request, when the contents server 10 accepts the acquisition request for the contents from a 
certain client terminal 20. 

15 As shown in Figure 8, the fingerprint performing part 14 first of all reads out the digital 
watermark-embedded contents Ce0[l], Ce0[2],.., Ce0[K], Cel[l], Cel[2],.., Cel[K] 
(hereinafter abbreviated as digital watermark-embedded contents Ce0[k], Cel[k]) for use to 
generate the fingerprint information from the digital watermark-embedded contents storage part 
13. Also, the embedment information m(n) is read from the predetermined storage device (step 

20 801). And the pseudo random number generator 142 calculates the seed k of pseudo random 
number based on the access information (user ED) contained in the acquisition request and a 
predetermined embedment key E (step 802). Namely, 

k = F(E,ID) (F is a function of calculating the seed) 

25 

Then, the pseudo random number generator 1 42 sets parameter n and the distribution contents 
Ce such as n = 1 and Ce = NULL (step 803), and decides a partial set Cf(n) of the contents with 
fingerprint for the parameter n, based on this parameter n, the seed k of the pseudo random 
number calculated at step 802, and the embedment information m(n) (step 804). Then, the 

30 contents selector 141 selects any of the partial sets Ce0[k](n) and Cel [k](n) for the parameter n 
in the digital watermark-embedded contents Ce0[k] and Cel[k]. The partial sets Ce0[k](n) and 
Cel[k](n) of the selected contents Ce0[k] and Cel[k] are temporarily held in the predetermined 
storage device (main memory 103 in the computer as shown in Figure 2). When the original 
contents C is also employed to generate the fingerprint information as with the method as 

35 shown in Figure 6, Cf(n) is selected from any of Ce0[k](n), Cel [k](n) and C(n). 
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Thereafter, the fingerprint performing part 14 couples the partial set Cf(n) of the contents for 
the decided parameter n with the distribution contents Ce already generated and held in the 
predetermined storage device (step 805). 

5 

Ce = Ce||Cf(n) 
Since initially, Ce=NULL at step 803, it follows that 
10 Ce = Cf(l) 

The distribution contents Ce generated up to step 805 are temporarily held in the predetermined 
storage device (main memory 103 in the computer as shown in Figure 2). 

15 Then, the fingerprint performing part 14 increments the value of parameter n by 1, and if the 
new value of parameter n is within the total number N of the partial sets C(n) of the original 
contents C, the operation gets back to step 804 to repeat the processing for the new parameter n 
(steps 806, 807). If the value of parameter n reaches N, the distribution contents Ce is 
completed and the operation is ended. 

20 

The completed distribution contents Ce are read out from the storage device, and distributed in 
accordance with a form of the network 30 to which the contents server 10 is connected (e.g., via 
the network interface 106 as shown in Figure 2) (step 808). When the distribution contents Ce 
are distributed in streaming, the partial sets Cf(n) of the contents with fingerprint decided at 
25 step 804 are sequentially distributed without waiting for completion of the distribution contents 
Ce. 

As described above, in this embodiment, a plurality of contents where a digital watermark is 
embedded are prepared, and combined and thereby the fingerprint information is added to the 
contents. Accordingly, the processing cost is lower, and the contents server 10 has a reduced 
30 load, unlike the case where the digital watermark containing the fingerprint information is 
embedded in the contents. Since the fast processing is made, this embodiment is suitable as a 
method for dynamically adding the fingerprint information to the contents after accepting an 
acquisition request for the contents from the client terminal 20. 

35 By the way, in the case where the original contents of distribution object are compressed, the 
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size of ttte partial set C(„) of the contents to embed fire 1 tat mformatron ts vaned dependmg on 
the value of n. Name.y, when the contents selector !«•»■*» *» *«? 
watermark-embedded contents CeO and the digital watermark-embedded contents Cel. tire 
switching timing can no. be provided for each consent number of bits. To solve tins, tite 

5 ' codeword sequence offset information (offset information of bit row) according to the 
compression format is generated to facilitate the switching for each n at tite same tune when 
generating the digital watermark-embedded contents CeO and Co!. And tins codeword 
Luence offset information is used as the pointer information pointing to a dehmtter posthon of 
the partial set of each compressed contents (table registering the codeword sequence offset 

10 information associated with the delimiter position). That is, tire fingerprint perfonnmg par. 14 
generates me contents Cf by switching the compressed digital watermark-embedded contents 
CeO and Cel at a position pointed to by the pointer information in the contents selector 141. 

In this manner, the compressed contents with fingerprint is generated by embedding arbitrary 
,5 information in tire compressed contents a. lower calculation cos, without 

compressed contents at all such as decoding the Huffman code or dequanuzmg by refernng to 
tire codeword sequence offset information. The codeword sequence offset information may be 
compressed and recorded to reduce the capacity of the distribuuon system. 

20 For example, when tire contents are compressed in MPEG2/4 AAC, the codeword sequence 
offset may be the number of bits for each taw data block or section. To reduce tite s,ze of the 
codeword offset information, a difference in the number of bits between adjacent raw data 
blocks or sections may be recorded. 

25 Figure 9 is a block diagram showing a process for making fingerprint with digital watermark in 
the compressed contents according to this embodiment, as compared with the conventional 



30 



process. 



35 



As shown in Figure 9, through the conventional process, to embed the digital watermark in the 
contents, the compressed contents are once unpacked (with dequantizing or inverse frequency 
conversion), the digital watermark is embedded, and then recompressed (with frequency 
conversion or quantizing) to generate a bit row describing the embedment information. On the 
contrary, in this embodiment, a bit row corresponding to the embedment information is 
generated by selectively switching the partial set of contents based on the embedment 
information (route indicated by the heavy line in Figure 9). Therefore, in this embodiment, an 
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operation surrounded by the broken line in Figure 9 is omitted, as compared with the 
conventional method. Accordingly, the processing cost for making the fingerprint on the 
contents is reduced, and the contents server 1 0 has a greatly reduced load. 

5 A process for generating the contents with fingerprint in this embodiment will be specifically 
described below, taking a process for embedding the distribution destination information in 
distributing the multi-media contents as an instance. 

In the on-line distribution of the image contents or audio contents, when there is a download 
10 request for the same contents from different users at the same time, a case is considered in 
which a digital watermark containing the different distribution destination information (user 
information) is embedded as the fingerprint in response to each request. The image contents or 
audio contents are usually compressed and distributed. However, employing this embodiment 
as above described, the distribution destination information as the fingerprint information can 
15 be added at lower calculation cost without unpacking the compressed contents. Particularly, 
this embodiment is effective for a streaming type contents distribution in which the real time 
processing is required. Also, the temporally changing information (e.g., time stamp) as the 
fingerprint information is dynamically embedded at lower processing cost. 

20 Specifically, the fingerprint information is added in distributing the contents compressed in 
MPEG-2/4 AAC in the following way. 

(1) Embedding 1 bit information per frame 

25 When embedding 1 bit information alone for one frame, the digital watermark-embedding part 
12 generates in advance a plurality of compressed contents where single bit information is 
embedded and the codeword sequence offset information describing the bit position for each 
raw data block, without regarding how the frequency components are dealt with, which are 
stored in the digital watermark-embedded contents storage part 13. The adjacent raw data 

30 blocks overlap by 50% along the time axis. Accordingly, if the compressed contents are 
selectively switched in a unit of raw data block when the fingerprint performing part 14 
generates the fingerprint information, switching of each stream is smoothly made without 
causing the noise. To correctly regenerate the contents generated by switching a plurality of 
streams, it is necessary that for each prepared compressed contents, the sampling frequency, 

35 channel number, and sound source start time are the same. 
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Figure 10 is diagram showing how to generate a bit row (1001..) representing the fingerprint 
information (embedment information) by switching the contents where a digital watermark 
corresponding to the value 0 of bit information is embedded and the contents where a digital 
watermark corresponding to the value 1 of bit information is embedded for each raw data block, 
5 in which the contents are compressed in MPEG-2/4 AAC. 

(2) Embedding plural pieces of bit information per frame 

When embedding plural pieces of bit information assigned for one frame, it is necessary to 
10 change a method for processing the frequency data within the raw data block. That is, the 
fingerprint performing part 14 has to switch the prepared contents within the raw data block. 
To perform this processing fast without solving the Huffman coding, it is required that the 
section information (section, sect_cb, scale factor) of the plurality of prepared contents is the 
same. If the section information is the same, spectral data in the individual channel can be 
1 5 switched for each Huffman codeword (every two or four frequency lines). 

The digital watermark-embedding part 12 generates beforehand a plurality of compressed 
contents where bit information is embedded and the codeword sequence offset information 
describing the bit position for each raw data block under the above conditions, which are stored 

20 in the digital watermark-embedded contents storage part 13. Since the prepared contents have 
the same time position and dynamic range, there is a high possibility that the section 
information is coincident. However, to correctly make the section information of the contents 
coincident, it is required to assure that an encoder for the digital watermark-embedding part 12 
performs a process for embedding the digital watermark at the time of compressing the 

25 contents, and at the same time outputs a plurality of compressed contents. 

In the first embodiment described above, the client terminal 20 transmits an acquisition request 
for the contents to the contents server 10, and in response to this request, the contents server 10 
30 transmits the contents with fingerprint to the client terminal 20. On the contrary, in the second 
embodiment, embedding a unique ID in the broadcast (including the multi-cast, and so forth) 
contents is implemented with fingerprint using the digital watermark. 

Figure 11 is a diagram schematically showing the overall configuration of a system for 
35 distributing the digital contents according to a second embodiment of the invention. 
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As shown in Figure 1 1 , the system of this embodiment comprises a broadcasting station 40 as 
the contents server that distributes the contents by broadcasting, and a receiving apparatus 50 as 
the client terminal that receives the contents distributed from the broadcasting station 40. 

5 

In the broadcast for forwarding the contents to a number of users at the same time, it is 
impossible to add different information (tracking code) for each distribution destination to the 
distributed contents. Thus, in the second embodiment, when distributing the contents, the 
contents having two or more different kinds of digital watermarks (digital watermarks 1, 2) 
10 inserted are transmitted at the same time, whereby the receiving apparatus 50 stores a plurality 
of received contents by switching the digital contents in accordance with a predetermined time 
sequence intrinsic to each receiving apparatus 50. That is, in the receiving apparatus 50, the 
contents with fingerprint are generated. Thereby, the fingerprint information different for each 
distribution destination can be embedded in the broadcast contents. 

15 

As described above, the broadcasting station 40 forwards the contents having two or more 
different kinds of digital watermarks (corresponding to bit information 0 and 1) inserted at the 
same time. However, these contents may be generated from the original contents using a digital 
watermark-embedding function implemented in the broadcasting station 40, which function is 

20 the same as for the digital watermark-embedding part 12 in the contents server 10 of the first 
embodiment as shown in Figure 3, or transmitted from the outside by preparing the digital 
watermark-embedded contents generated from the predetermined original contents. As 
described in the first embodiment with reference to Figure 6, the contents not containing the 
digital watermark corresponding to bit information may be mixed. The means for broadcasting 

25 the contents may widely include the electric wave broadcasting such television broadcasting, 
wire broadcasting and information communication network. 

The receiving apparatus 50 comprises a receiving component 51 for receiving the distributed 
contents, and a contents using part 52 for using (regenerating, perusing) the received contents, 
30 as shown in Figure 1 1 . 

The receiving component 51 is realized by a set top box (STB) dedicated for the television 
receiver, for example, and has a function of receiving the general contents, and a function of 
processing the received contents to be usable in the contents using part 52, as well as in this 
35 second embodiment, the same function of the fingerprint performing part 14 in the contents 
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server 10 of the first embodiment as shown in Figure 3. That is, a plurality of contents of the 
same contents where a digital watermark corresponding to the bit information 0 or 1 is 
embedded are switched and synthesized for each specific part. Thereby, the contents having 
embedded the fingerprint information described in a bit row being formed by the digital 
5 watermark are generated. 

In this embodiment, an intrinsic apparatus ID (DM, ID-2, .., ID-M in the illustrated example) is 
attached to each receiving apparatus 50, and held in a predetermined storage device such as a 
semiconductor memory. The receiving component 51 selectively switches a partial set of the 
contents where a digital watermark corresponding to the value 0 of bit information is embedded 
and a partial set of the contents where a digital watermark corresponding to the value 1 of bit 
information is embedded in accordance with a time sequence intrinsic to each receiving 
apparatus 50 that is decided on the basis of this apparatus ID, and generates the fingerprint 
information intrinsic to each receiving apparatus 50. 

For example, assuming that the M distribution contents at time t are Ii(t) (i = 1,.., M), and the 
embedment information dependent on the apparatus ID is O ro (t), Oio(t) = W)(t) where f(t,ID) is 
a function of outputting an integer from 1 to n in accordance with the time t. For any ID pair X, 
Y (X 1 Y), there is a certain period to<t<ti for which f(t,X) 1 f(t,Y) is satisfied. 

A specific operation for adding the embedment information as the fingerprint information to the 
contents is the same as the process performed by the fingerprint performing part 14 in the first 
embodiment and described with reference to Figure 8. In this embodiment, the pseudo random 
number generator 142 calculates the seed of the pseudo random number function in accordance 
with a time sequence based on the apparatus ID, and the contents selector 141 is controlled in 
accordance with a pseudo random number sequence calculated from this seed. 

In the above manner, a sequence (secondary information) unique for each distribution 
destination and varying with the elapse of time can be embedded in the contents. The 
30 information designating the distribution destination alone may be embedded irrespective of the 
elapse of time, depending on the use mode or purpose of the fingerprint information embedded 
in the contents. Conversely, the information designating the distribution time alone may be 
embedded irrespective of the distribution destination. Furthermore, other parameters than the 
distribution destination and the distribution time may be set and embedded as the fingerprint 
35 information in the contents. 
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The contents using part 52 is realized by a television receiver, for example, to regenerate the 
contents with fingerprint received by the receiving component 5 1 . 

5 The receiving apparatus 50 comprises a storage means (not shown) such as a magnetic disk unit 
that can store the contents via the receiving components 5 1 . 

The distribution destination and the distribution time of the contents are designated by the 
fingerprint information embedded in the contents in this embodiment. Accordingly, when the 
10 period or time zone where the specific contents are frequently distributed is investigated or the 
secondary distribution of the predetermined contents is made, it is possible to determine 
whether or not the distribution is made without legal right by investigating the source or the 
primary distribution mode. 

15 In this embodiment, a plurality of contents where a digital watermark is embedded are 
distributed at the same time, and synthesized by the receiving apparatus 50 to add the 
apparatus-intrinsic information to the contents. A method for describing the information by 
combining a plurality of contents where a digital watermark is embedded, rather than adding the 
information by embedding the digital watermark in the contents has a lower processing cost and 

20 a high speed, and is suitable for adding the information in the contents received by the receiving 
apparatus 50. Accordingly, the information intrinsic to the distribution destination can be added 
to the contents in the broadcast or multi-cast with no designation of the distribution destination. 

As described above, with this invention, it is possible to embed a different digital watermark in 
25 the digital contents for each access without increasing load at the contents server to the utmost. 

Also, it is possible to implement a digital contents distribution system practically on line using 
* such a digital watermark-embedding technique. 

30 While the invention has been described with respect to certain preferred embodiments and 
exemplifications, it is not intended to limit the scope of the invention thereby, but solely by the 
claims appended hereto. 

35 
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claim: 

A contents server distributing digital contents via a network in response to an 
acquisition request from outside, said contents server comprising: 

a contents storage part for storing a plurality of digital contents wherein a different 
digital watermark is embedded; and 

an information adding part for, by reading out a plurality of said digital contents 
from said contents storage part, switching and synthesizing said digital contents for 
each specific part, adding to said digital contents information specified by a digital 
watermark being embedded for each part of said digital contents. 

The contents server according to Claim 1 , wherein said information adding part 
dynamically adds said information to said digital contents in response to an acquisition 
request for predetermined digital contents. 

The contents server according to Claim 1 , wherein said information adding part forms 
a bit row with a digital watermark-embedded for each part of said digital contents and 
describes said information in said digital contents with said bit row. 

The contents server according to Claim 1 , wherein said contents storage part stores said 
digital contents compressed in a predetermined compression format, and said 
information adding part for, by synthesizing a plurality of said digital contents based on 
the codeword sequence offset information regarding said digital contents in accordance 
with said compression format, adding said information without unpacking said digital 
contents. 

A contents receiving apparatus for receiving digital contents distributed by a 
predetermined distributor, said contents receiving apparatus comprising: 

a receiving means for receiving a plurality of digital contents wherein a different 
digital watermark is embedded; and 

an information adding means for, by switching and synthesizing a plurality of said 
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digital contents received by said receiving means for each specific part, adding to said 
digital contents information specified by a digital watermark being embedded for each 
part of said digital contents. 

5 (6) The contents receiving apparatus according to Claim 5, wherein said information 

adding means adds to said digital contents the information designating the self 
apparatus and the information regarding the time when said digital contents are 
distributed. 

1 0 (7) The contents receiving apparatus according to Claim 5, wherein said information 

adding means forms a bit row with a digital watermark-embedded for each part of said 
digital contents and describes said information in said digital contents with said bit 
row. 

1 5 (8) The contents receiving apparatus according to Claim 5, wherein said receiving means 

receives said digital contents compressed in a predetermined compression format, and 
said information adding means adds said information without unpacking said digital 
contents by synthesizing a plurality of said digital contents based on the codeword 
sequence offset information regarding said digital contents in accordance with said 

20 compression format. 

(9) A network system comprising a server distributing digital contents via a network, and a 
client terminal receiving said distributed digital contents wherein: 

said client terminal transmits an acquisition request for desired digital contents to 
25 said server; and 

said server, by switching and synthesizing for each specific part a plurality of 
digital contents wherein a different watermark is embedded, generates digital contents 
wherein a predetermined information responding to said acquisition request is 
30 embedded and transmits said digital contents to said client terminal. 

(10) A network system comprising a server distributing digital contents, and a client terminal 

receiving distributed digital contents wherein: 

35 said server distributes simultaneously a plurality of digital contents wherein a 
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different digital watermark is embedded; 

said client terminal adds, by switching and synthesizing said plurality of received 
digital contents for each specific part, a predetermined information to said digital 
5 contents. 

(1 1) A computer comprising: 

a selector for inputting a plurality of digital contents wherein a different digital 
1 0 watermark is embedded, and for outputting while switching selectively said plurality of 

digital contents for each specific part; and 

a control part for controlling said selector based on a predetermined embedment 
information, said computer generating by a control at said control part, digital contents 
1 5 wherein said embedment information is described with a bit row being formed by said 

digital watermark-embedded in each of said part of said digital contents. 

(12) The computer according to Claim 11, wherein said selector inputs a plurality of digital 

contents where a digital watermark representing the bit information 0 is embedded, and 
20 a plurality of digital contents where a digital watermark representing the bit 

information 1 is embedded, and selects digital contents where a digital watermark 
corresponding to desired bit information is embedded under a control of said control 
part. 

25 (13) The computer according to Claim 1 1, wherein said selector inputs to said selector digital 

contents where a digital watermark representing the bit information 0 is embedded, 
digital contents where a digital watermark representing the bit information 1 is 
embedded, and digital contents where a digital watermark is not embedded, and selects 
said digital contents under a control of said control part whereby a portion containing 

30 no bit information is set in said bit row describing said embedment information. 

(14) The computer according to Claim 11, wherein said selector selectively switches said digital 
contents, based on the pointer information pointing to a delimiter for said part of said 
digital contents. 

35 
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(15) The computer according to Claim 14, wherein said selector inputs said digital contents 
compressed in a predetermined compression format, and selectively switches said 
digital content, using the codeword sequence offset information regarding said digital 
contents in accordance with said compression format as said pointer information. 

5 

(16) A method for adding information to digital contents by using a computer, said method 
comprising; 

a first step of generating a plurality of digital watermark-embedded contents by 
embedding a different digital watermark in predetermined digital contents, and of 
storing generated digital contents to a predetermined storage device; and 

a second step of, by reading out from said storage device a plurality of digital contents 
where a different digital watermark is embedded and switching and synthesizing said 
digital contents for each specific part, adding to said digital contents information 
specified by a digital watermark being embedded in each part of said digital contents. 

(17) The method for adding information to digital contents according to Claim 16, wherein said 
first step comprises compressing said generated digital contents, creating the pointer 
information pointing to a delimiter position in the part of said compressed digital 
contents, and storing it in said storage device, and said second step comprises reading 
out said pointer information from said storage device, synthesizing said digital contents 
based on said pointer information, and adding said information without unpacking the 
digital contents. 

(1 8) A program for causing a computer to perform the data processing by controlling a 
computer, comprising: 

a first process for reading out predetermined embedment information from a 
30 predetermined storage device; and 

a second process for acquiring a plurality of digital contents where a different digital 
watermark is embedded, selectively switching said plurality of digital contents for a 
specific part, based on said embedment information, and generating the digital contents 
35 describing said embedment information, using a bit sequence formed with a digital 
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watermark-embedded in said part of said digital contents. 

(19) The program according to Claim 18, wherein said second process of said program 
performed by said computer comprises acquiring a plurality of digital contents where a 

5 digital watermark representing the bit information 0 is embedded, and a plurality of 

digital contents where a digital watermark representing the bit information 1 is 
embedded, and selecting digital contents where a digital watermark corresponding to 
appropriate bit information describing said embedment information is embedded. 

(20) The program according to Claim 18, wherein said second process of said program 
performed by said computer comprises acquiring digital contents where a digital 
watermark representing the bit information 0 is embedded, digital contents where a 
digital watermark representing the bit information 1 is embedded, and digital contents 
where a digital watermark is not embedded, and generating digital contents describing 
said embedment information, using said bit sequence with said digital watermark 
where a portion containing no bit information is set. 

(21) The program according to Claim 18, wherein said second process of said program 
performed by said computer comprises acquiring said digital contents compressed in a 

20 predetermined compression format, and selecting said digital contents, based on the 

codeword sequence offset information regarding said digital contents in accordance 
with said compression format. 
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CONTENTS SERVER, CONTENTS RECEIVING APPARATUS, NETWORK SYSTEM 
5 AND METHOD FOR ADDING INFORMATION TO DIGITAL CONTENTS 

ABSTRACT 

Method and system for embedding a unique and different digital watermark in digital contents 
10 for each access without increasing the overhear or load at the contents server. The contents 
server has a digital watermark-embedded contents storage unit for storing a plurality of digital 
contents where a different digital watermark is embedded, and a fingerprint performing unit for, 
adding to the digital contents the information specified using a bit row that is formed by a 
digital watermark being embedded for each part of the digital contents. 

15 
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